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Over the past thirty years, the federal government, states, districts, and schools have experimented with many 
different strategies to improve school quality when faced with persistent negative outcomes like low test scores 
and stagnant graduation rates. What do we know about the effectiveness of these varied strategies? What 
challenges emerge in implementation? And how can city leaders generate and sustain support for school 
improvement efforts? 


There are numerous ways to try to improve schools. Some strategies, which we call turnaround strategies, aim to 
improve existing schools. These include reconstituting schools with new staff, innovation zones, and contracts 
with non-district operators to manage existing schools (see table 1 for more detail). Other strategies, which we 
call new school strategies, enable students to enroll in better school options. These include school closure and 
investments in new school pipelines for cities with few high-performing options. (We explain these more fully 
in table 2.) 


Each of the five strategies represents a distinctive way to tackle the challenge of school underperformance. 
Design and implementation necessarily vary from place to place, and every initiative is constrained by local 
factors like resources, politics, and leadership. As a result, even the most rigorous evaluation evidence cannot 
tell us definitively whether the strategy will find success elsewhere. 


This brief provides an overview of five strategies used for persistently underperforming schools that demand 
significant changes to how schools are organized. We conclude with questions that leaders can use to guide 
and assess implementation. 
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Assessing the Evidence Base on School Improvement 


This brief draws upon published research, as well as the experiences of cities pursuing different types of 
improvement strategies. We conducted a scan of the literature in academic journals (¢.g., Journal of Education 
Finance and Policy) using the search engine Google Scholar, and through public policy outlets (e.g., University of 
Chicago Consortium on School Research). We considered a broad array of evidence, including: 


e Rigorous, quasi-experimental impact evaluations, such as those deploying regression discontinuity, which 
offer the best assessment of whether a school improvement strategy improved outcomes for students.! 


¢ Qualitative and mixed method implementation studies, which can provide insight into both a strategy’s 
mechanisms of action (how it works) as well as the systemic factors that shape success. 


e Anecdotal evidence stemming from media accounts and conversations with system leaders to 
understand how school improvement strategies are perceived by stakeholders. 


1. Experimental evidence, often referred to as the “gold standard,” is generally not available on school improvement since it is rarely possible to randomly 
assign students or schools to receive tightly controlled interventions. 


What We Know About Five School Improvement Strategies 


While the features of the improvement strategies we review are varied, none provide any guarantees of success and 
each faces some common challenges. 


e When it comes to results, how cities implement these strategies matters as much or more than what type of 
strategy is used. 


e Implementation challenges are common, as citywide initiatives run aground in the face of political conflicts, 
organizational inertia, lack of qualified teachers and principals, and finite funding streams. 


Tables 1 and 2 summarize the characteristics of each improvement strategy, results to date, and the implementation 
factors that research suggests shapes success. 


Turnaround strategies aim to improve existing schools. While all states require improvement plans that put in place 
changes to curriculum, instruction, and educator effectiveness, in this brief we focus on three strategies that restructure 
schools through new governance and staffing arrangements. These include school reconstitution, innovation zones, 
and charter conversion (see Table 1). While each of these strategies represent distinctive approaches to improvement, 
there are important differences within the strategies that localities put into place. For example, cities employing 
reconstitution vary in terms of how many staff are replaced and the terms by which new staff are hired. 
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TABLE 1. Turnaround Strategies 


Strategy Approach Common Challenges Notable Examples 


S 


School 


Replace New leaders e Inadequate number of Chicago, Los Available evidence 
reconstitution most or all and teachers qualified teachers and Angeles, suggests reconstitution 
incumbent will bring principals to replace Washington, D.C., has uneven impacts. 
school leaders fresh energy existing staff. Federal School Effects of staff 
and staff. and skills. * Lack of high-quality Improvement replacement depend 
professional support Grants on the recruitment and 
staff. retention of effective 
teachers and principals. 

° Loss of effective Two studies suggest 
incumbent teachers schools that replaced 
who leave during more teachers were 
reconstitution process. more likely to improve, 

* Support resources but other studies find 
required may not be no difference and some 
sustainable over time. identify negative impacts 

for historically hard-to- 
staff schools. 
Innovation Cluster of With greater * Schools unable to recruit Denver, Positive results among TN 
zones schools autonomy and retain effective Indianapolis, iZone schools. Indications 
receives and funding, teachers. Shelby County, of positive results in 
rac REROIEl—s schoceadershipteam Srna oo 
vas lacks capacity to take Sats : 
flexibility over changes eae Some indication that good 
: ; on new responsibilities : 
staffing and to improve under autonomy. results are driven by the 
budgeting. student selection and retention 
learning. * District policy impedes of effective teachers and 
school autonomy. leaders. 

e Extra funding sources 
dry up. 

Charter Charter Using * Operators often not Green Dot in CA No positive impact in TN 

conversion operator regulatory prepared to deal with and TN, Tennessee ASD. Anecdotal, positive 
takes over autonomy, turnaround challenge ASD, UP Education evidence for Green 
management charter in whole-school or Network in Dot and UP Education 
of a low- schools will neighborhood-based Massachusetts Network. Indication that 
performing hire staff context. results are shaped by 
Se enee arate nto * Leekofstrong charter fee 
changes staff, better align echoes! eperatonintenes to qualified teachers and 


instructional 
practice, and 
schedule. 


*Note: See resource list for sources. 


with student 
needs. 


Politics around charter 
schools may limit 
conversion options. 


support providers (é.g., 
special education), and 
local stakeholder support. 


New school strategies are designed to help students enroll in a better school. These include school closure and 
the intentional development of new school pipelines by issuing requests for proposals (RFPs). Many districts have 
combined school closure with new school development by using phase-in phase-out, close-and-replace, or restart 


strategies. However, we present closure and new school pipelines separately (see Table 2). 
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A growing number of cities are also employing partnership strategies, where a district works with a charter operator or 
nonprofit to manage a district neighborhood school on an annual, renewable contract. This includes Atlanta, Camden, 
Indianapolis, and Philadelphia. There are a number of specific issues related to this improvement model, all of which 
are captured within “charter conversion” and “RFPs for new schools.” 


TABLE 2. New School Strategies 


Strategy Approach Common Challenges Notable Examples 


School 
closure 
based on 
persistent 
low 
performance 


RFPs for 
new schools 


Schools are 
held to high 
performance 
standards. 
Schools that 
cannot meet 
the standards 
are closed. 


District 
requests 
proposals for 
new school 
designs, often 
identifying 
the location 
where anew 
school is 
needed. New 
schools are 
operated by 
districts or 
charters. 


*Note: See resource list for sources. 


Poor-performing 
schools ina 
system will 
either close 
or improve 
(motivated 

by threat of 
closure). If the 
school closes, 
students 

will attend 
better schools 
elsewhere. 


New staff, 
students, and 
school will bring 
a “fresh start” 
and build new 
culture. 
Intentional 
development 
will result in a 
good match 
with community 
needs. 


¢ Lack of quality options for 
students to transfer to. 


¢ Politics of closure and 
unavailability of empty 
facilities can make 
strategy unsustainable 
over time. 


* Poor community 
engagement practices 
impede poor-performing 
schools from closing. 


* Destabilizing impact 
of school closure 
on students and 
communities. 


° City unable to attract 
qualified operators and/ 
or school leaders. 


* Politics, lack of facilities, 
and lack of funds limit 
growth of quality school 
options (especially in the 
case of charters). 


¢ New schools are not 
vetted to ensure they are 
prepared to succeed. 


¢ Students most in need 
of high-quality options 
cannot access the new 
schools (information, 
location). 


Boston, New 
Orleans, New 
York City, 
Oakland, 


Washington, D.C. 


Baltimore, 
Cleveland, 
Denver, 
Indianapolis, 
New Orleans, 
New York City, 
Philadelphia 


Most studies on school 
closure find no short- 
term or long-term 
positive impacts on 
test scores for students 
in the closed schools. 
Results are more 
positive when students 
from closed schools 
transfer to higher- 
performing schools 

or when schools use 
phase-outs. Test 
scores for students 

in welcoming schools 
are not impacted 
long-term. The impact 
on attendance and 
graduation rates is 
mixed. 


New Orleans showed 
initial, sustained 
improvement, but 
there has been recent 
decline. NYC’s small 
high schools improved 
graduation rates and 
college-going rates. In 
Philadelphia, diverse 
provider schools 
performed similarly 
to other district 
schools. In Baltimore, 
new “transformation” 
schools struggled to 
make academic gains 
and most eventually 
closed. 


None of the five strategies outlined here offers a surefire way to improve schools, but any of them is more likely 
to succeed when operating under the right circumstances. Pursuing multiple strategies, making the most of the 
capacities that exist across both the district and charter sectors, and regularly taking stock of what’s working increase 
the odds that cities will find success. Varying the approach may also help education leaders manage the inevitable 
political fallout that comes from overuse of any one strategy. 
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Questions to Ask When Choosing or Assessing an Improvement Strategy 


Each strategy represents a distinctive approach to improving schools, but all require city leaders to address the 
following critical questions: 


1. Do schools have the staff they need? If not, is there a strategy to develop or attract talent? All school 
improvement strategies require dedicated and qualified teachers and school leaders, but certain 
strategies, like an autonomy or innovation strategy, may require specific leadership or teacher skills. A 
city will need to assess the quantity and quality of its talent across both district and charter schools and 
be prepared to adjust policies related to recruitment, placement, training, or development. 


2. What role can charter operators play? In a number of cities, school districts have sought to tap capacity 
in the nonprofit charter sector to support school improvement. Leveraging charter schools to support 
school improvement requires attention to the spillover effects that such strategies often generate. This 
includes preparing for shifts in enrollment, transportation, special education, and other services that 
impact families’ access to charter schools and paying attention to the policy environment that shapes 
charter school efficacy (e.g., accountability, facilities, and funding). District and charter leaders must be 
prepared to work together to make sure charter schools can productively contribute to the improvement 
strategy, which can prove challenging when the sectors lack a history of collaboration. 


3. Can you build support and survive opposition? Every school, even a persistently underperforming 
school, has a loyal constituency. As cities consider an intervention, success may well ride on their ability 
to make a clear and compelling case to families and educators that the time has come for bolder action. 
Finding natural leaders among the current families who are willing to work in partnership - whether 
around closure, charter conversion, or reconstitution - will help to create a more authentic solution and 
manage the inevitable backlash from opponents. A citywide improvement strategy will need support 
from multiple levels, including community-based organizations, families, and educators as well as 
members of the civic, funder, and business communities. Education leaders can build trust by being 
transparent and realistic: avoid overpromising and underdelivering. 


4. Can education leaders monitor the success of the strategy? Cities should clearly communicate 
the challenges that exist in low-performing schools and the strategies they are using to address 
underperformance. They also need to be transparent about progress or lack thereof so that families can 
hold the district or charter schools accountable, and so that leaders can understand which strategies 
work best under which conditions. To do this, the city needs capacity to collect, analyze, and publish 
data about how the improvement strategy is working, with special attention on the schools and student 
populations that are not finding success. Progress, or the lack thereof, should be relayed to families and 
community members throughout the process. 


5. Are long-term financial resources available? Many of the improvement strategies discussed in this 
brief require the infusion of resources. City leaders must carefully assess what each strategy means in 
terms of long-term financial obligations and put in place plans to ensure that strategies can find success 
over the longer term, regardless of changes in short-term revenues. This may include funding for talent 
development or longer days/years, new schools, new organizations, or community engagement efforts. 


Every city struggles with some schools that persistently underperform and most have tried some array of interventions. 
Some cities have had success with the five strategies we explore in this brief, but there has been little in the way 
of understanding the elements that contributed to their success. Going forward, cities should consider building a 
strategy that incorporates multiple improvement strands and that tracks their efforts so they can determine which 
ones are promising and why. 
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Resources 
Research on multiple improvement strategies 


American Institutes for Research, How to Succeed in Schoo! Turnaround: Strategies That Characterize Successful 
Turnaround Schools in Massachusetts, American Institutes for Research, 2016. 


Marisa de la Torre et al., Zurning Around Low-Performing Schools in Chicago, The University of Chicago Consortium 
on Chicago School Research, 2013. 


Lisa Dragoset et al., Schoo/ Improvement Grants: Implementation and Effectiveness Executive Summary, Institute of 
Education Sciences, January 2017. 


Patrick Lester, Evidence-Based Comprehensive School Improvement: How Using Proven Models and Practices Could 
Overcome Decades of Failure, Social Innovation Research Center, March 2018. 


Christina LiCalsi and Dionisio Garcia Piriz, Eva/uation of Level 4 Schoo! Turnaround Efforts in Massachusetts, Part 2: 
Impact of School Redesign Grants, American Institutes for Research, 2016. 


Katharine O. Strunk et al., “The Impact of Turnaround Reform on Student Outcomes: Evidence and Insights from the 
Los Angeles Unified School District,” Education Finance and Policy 11(3): 251-282, 2016. 


Min Sun, Emily Penner, and Susanna Loeb, “Resource- and Approach-Driven Multidimensional Change: Three-Year 
Effects of School Improvement Grants,” American Educational Research Journal 54(4): 607-643, 2017. 


School reconstitution 


Jennifer A. Heissel and Helen F. Ladd, “Schoo/ Turnaround in North Carolina: A Regression Discontinuity Analysis,” 
Economics of Education Review 62: 302-320, 2018. 


ar 


Betty Malen et al., “Reconstituting Schools: ‘Testing’ the ‘Theory of Action’,” Educational Evaluation and Policy Analysis 
24(2): 113-132, 2002. 


Katharine O. Strunk etal., “Innovation and a Return to the Status Quo: A Mixed-Methods Study of School Reconstitution,” 
Educational Evaluation and Policy Analysis 38(3): 549-577, 2016. 


Sarah Yatsko et al., Tinkering Toward Transformation: A Look at Federal School Improvement Grant Implementation, 
Center on Reinventing Public Education, University of Washington, 2012. 


Innovation zones 


Gary T. Henry et al., Recruitment and Retention of Teachers in Tennessee’s Achievement School District and iZone 
Schools: A Policy Brief on Driving Improvement in Low-Performing Schools, TN Education Research Alliance, Vanderbilt 
University, 2017. 


Ron Zimmer et al., Eva/uation of the Effect of Tennessee’s Achievement School District on Student Test Scores, 
Tennessee Consortium on Research, Evaluation and Development, Vanderbilt University, 2015. 


School closure 


Whitney Bross, Douglas N. Harris, and Lihan Liu, The Effects of Performance-Based School Closure and Charter 
Takeover on Student Performance, Education Research Alliance for New Orleans, Tulane University, October 2016. 


Quentin Brummet, 7he Effect of School Closing on Student Achievement, Job Market Paper, September 2012. 


Deven Carlson and Stephane Lavertu, Charter Schoo/ Closure and Student Achievement from Ohio, Journal of Urban 
Economics 95: 31-48, 2016. 
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Molly Gordon et al., Schoo/ Closures in Chicago: Staff and Student Experiences Academic Outcomes, University of 
Chicago Consortium on Chicago School Research, May 2018. 


Chunping Han et al., Volumes | and II of “Lights Off: Practice and Impact of Closing Low-Performing Schools,” Center 
for Research on Education Outcomes, Stanford University, 2017. 


James Kemple, High Schoo/ Closures in New York City: Impacts on Students’ Academic Outcomes, Attendance, and 
Mobility, The Research Alliance for New York City Schools, NYU, 2015. 


Ben Kirshner, Matthew Gaertner, and Kristen Pozzoboni, “Tracing Transitions: The Effect of High School Closure on 
Displaced Students,” Educational Evaluation and Policy Analysis 32(3): 407-429, 2010. 


RFPs for new schools 
Harold Bloom and Rebecca Unterman, Sustained Progress: New Findings about the Effectiveness and Operation of 
Small Public High Schools of Choice in New York City, MDRC, August 2013. 


CREDO, Charter Schoo! Performance in New Orleans, Center for Research on Education Outcomes, Stanford University, 
August 2013. 


Brian Gill et al., State Takeover, Schoo! Restructuring, Private Management, and Student Achievement in Philadelphia, 
RAND Corporation, 2007. 


Charter conversion and partnership schools 


Whitney Bross, Douglas Harris, and Lihan Liu. Extreme Measures: When and How School Closures and Charter 
Takeovers Benefit Students, Education Research Alliance, October 2016. 


Julie Corbett, Chartering Turnaround: Leveraging Public Charter School Autonomy to Address Failure, National Alliance 
for Public Charter Schools, 2015. 


Eva Gold et al., Philadelphia’s Renaissance Schools Initiative: 18-Month Interim Report, Research for Action, 2012. 


Joan L. Herman et al., Eva/uation of Green Dot’s Locke Transformation Project: Findings From the 2007-08, 2008-09, 
and 2009-10 School Years, The National Center for Research on Evaluation, Standards, and Student Testing, University 
of California, Los Angeles, 2011. 


Diane Massell, Joshua Glazer, and Matthew Malone, “This is the Big Leagues” Charter-Led Turnaround in a Non-Charter 
World, Tennessee Consortium on Research, Evaluation and Development, Vanderbilt University, 2016. 


Ron Zimmer, et al., Eva/uating the Performance of Philadelphia’s Charter Schools, RAND Corporation, 2008. 
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